TITLE OF THE INVENTION 



IMAGE SENSING APPARATUS AND 
IMAGE PROCESSING METHOD THEREFOR 

BACKGROUND OF THE INVENTION 

The present invention relates to an image sensing 
apparatus such as a digital camera or digital video 
camera or the like, and an image processing method for 
the image sensing apparatus . 

A conventional single-plate color digital camera 
is a lens -integrated system ,and is generally incapable 
of exchanging a lens. For this reason, an optical low 
pass filter and infrared ray (IR) filter or the like 
are provided before a CCD, which generates image 
signals according to light passing through the lens, 
thereby achieving a certain degree of effectiveness in 
reducing rnoir^ or pseudo colors (erroneous colors ) , 
However, in a case of a camera which allows lens 
exchange, an IR filter can be provided before a CCD by 
forming a thin film on a glass surface of the CCD. 
However, securing space for an optical low pass filter 
before a CCD causes to increase the size of the camera 
body. Furthermore, although such optical low pass 
filter can reduce moir6 or pseudo colors to a certain 



degree, a problem arises in that spatial frequency of 
an image decreases , and as a result , the image loses 
exact -focused characteristic such as that obtained in 
silver chloride photographs . Because of the above 
reason, the importance of an optical system without an 
optical low pass filter is increasing. 

Furthermore, even if such optical low pass filter 
is provided, in a case of a digital camera employing a 
single-plate CCD, pseudo colors are still generated 
when color interpolation is performed. As exemplified 
by the Bayer pattern, when a number of R (red) and B 
(blue) color components is less than that of G (green) 
color components, the gap between these pixels becomes 
large, and this causes generation of pseudo colors in 
color interpolation. Furthermore, a method of 
generating three color planes with a digital filter or 
the like is available as a conventional color 
interpolation. However, since the order of the digital 
filter is limited, original image data resolution 
cannot be sufficiently expressed. 

In view of the above, conventionally proposed is 
to perform image processing, particularly color 
interpolation, disclosed in US Patent No, 5,373,322 or 
No. 5,629,734, to obtain high resolution image data. 
This technique is effective to reduce pseudo colors, 
but not effective for moir6 . 



Even with the conventional technique, isolated 
pseudo colors , generated particularly around small 
characters or the like, cannot completely be eliminated. 
In view of this, it is proposed to convert color space, 
5 e.g., from RGB to L*a*b*, by an application program 

operating in a computer, and perform processing such as 
filtering on a* and b* to remove pseudo colors. 
C3 However, even if such conventional technique is 

employed, pseudo colors in color interpolation cannot 

t.U 

10 completely be eliminated. This is further described 



CO below. 

As shown in Fig. 19, if vertical white lines are 



u 

l^^h exposed to green (G) and red (R) lines of a CCD at 

i'Q pixel pitch and conventional color interpolation is 

;S 15 performed, red (R) and yellow (Y) vertical stripes are 

Obtained (in Fig. 19, hatching portion indicates black 
where data is 0). Similarly, as shown in Fig. 20, if 
vertical white lines are exposed to green (G) and blue 
(B) lines of a CCD at pixel pitch and color 
20 interpolation is performed, blue (B) and cyan (C) 

vertical stripes are obtained. Note that even if the 
stripes in Figs. 19 and 20 are horizontal instead of 
vertical, the same results, i.e., red (R) and yellow 
(Y) stripes or blue (B) and cyan (C) stripes, are 
25 obtained. 

Furthermore, as another pattern, if white pixels 



- 3 - 



having a checker flag pattern shown in Fig, 21 are 
expotied to K ana B of a CCD and color interpolation is 
performed, a magenta (M) image is obtained despite the 
original white color. Still further, if white pixels 
having a checker flag pattern shown in Fig. 22 are 
exposed to G of the CCD and color interpolation is 
performed, a green (G) image is obtained despite the 
original white color. 

In order to remove such pseudo colors, the color 
space is converted from RGB to, for instance, L*a*b* 
and filtering is performed on each of the a* and b* 
color spaces by an application program operating in a 
personal computer. However, in the case of checker 
flag patterns shown in Figs. 21 and 22, a low frequency 
image of green cannot be distinguished from that of 
magenta, making it impossible to determine pseudo 
colors. If the frequency band of color difference is 
forcefully limited for JPEG compression, a dull 
(blurred) image is obtained. As a result, although the 
level of pseudo colors is reduced, the pseudo color 
components are spread out to the peripheral pixels , 
causing problems. 

Furthermore, if the image data is compressed 
according to JPEG or the like without performing above - 
described pseudo color removing processing, block noise 
or the like may be caused. Moreover, if the frequency 



band of color difference is forcefully limited for JPEG 
compression, an image becomes blurred. As a result, 
although the level of pseudo colors is reduced, the 
pseudo color components are spread out to the 
peripheral pixels, causing problems. In order to 
eliminate such pseudo colors, it is ideal to employ a 
three-plate camera using three image sensing devices 
for each color component. However, such construction 
increases the size and cost of the camera. 

SUMMARY OF THE INVENTION 

The present invention is made in consideration of 
the above situation, and has as its object to provide 
an image sensing apparatus capable of reducing pseudo 
colors generated by color interpolation, and an image 
processing method for the image sensing apparatus. 

Furthermore, another object of the present 
invention is to provide an image sensing apparatus 
which can reduce pseudo colors without increasing the 
size or cost of the image sensing apparatus, and an 
image processing method for the image sensing apparatus. 

Furthermore, another object of the present 
invention is to provide an image sensing apparatus 
which can reduce pseudo colors with relatively a simple 
construction, and an image processing method for the 
image sensing apparatus- 



Furthermore, Another object of the present 
Invention Is to provide an image sensing apparatus 
which can reduce pseudo colors in isolated pixels with 
relatively a simple construction, and an image 
processing method for the image sensing apparatus. 

In order to attain the above-described objects, 
the image sensing apparatus according to the present 
invention has the following configuration. 

More specifically, the present invention provides 
an image sensing apparatus comprising: an image sensing 
device; image forming means for forming an image on 
said image sensing device; A/D conversion means for 
converting an image signal outputted by said image 
sensing device into a digital signal; color 
interpolation means for performing color interpolation 
on the digital signal converted by said A/D conversion 
means and generating image data on a plurality of color 
planes; color space conversion means for converting a 
color space of the plurality of color planes to a color 
space of another colorimetric system; and isolated 
point removing means for reducing a pseudo color, 
generated by said color interpolation means , by 
controlling a color difference signal converted by said 
color space conversion means . 

Furthermore, the present invention provides an 
image sensing apparatus comprising: an image sensing 



device; image forming means for forming an image on 
said image sensing device; A/D conversion means for 
converting an image signal outputted by said image 
sensing device into a digital signal; color 
interpolation means for performing color interpolation 
on the digital signal converted by said A/D conversion 
means and generating image data on a plurality of color 
planes; pseudo color removing means for reducing a 
pseudo color component included in image data, on which 
color interpolation is performed by said color 
interpolation means; color space conversion means for 
converting a color space of the plurality of color 
planes, where a pseudo color is reduced by said pseudo 
color removing means , to a color space of another 
colorimetric system; and compression means for 
compressing image data where color space is converted 
by said color space conversion means. 

Herein, the isolated point removing means 
includes an isolated point removing filter which 
replaces a value of a pixel of interest with a 
substantial median pixel value of peripheral pixels of 
the pixel of interest. Also, the isolated point 
removing filter includes a median value filter or 
median filter . 

Moreover, the color interpolation means generates 
image data in R, G and B planes. 



Further, the color space conversion means may 
convert RGB color space to YUV color space . 

Still further, the color space conversion means 
may convert RGB color space to Y, R-Y, B-Y color space. 

Still further, the color space conversion means 
may convert RGB color space to G, R-G, B-G color space. 

Moreover, the image forming means includes an 
infrared ray filter, or an infrared ray filter and 
optical low pass filter. 

Furthermore, the image processing method for the 
image sensing apparatus according to the present 
invention has the following steps. 

More specifically, the present invention provides 
an image processing method for an image sensing 
apparatus which includes an image sensing device and 
generates an image signal corresponding to an image 
formed on the image sensing device, comprising: an A/D 
conversion step of converting an image signal outputted 
by the image sensing device into a digital signal; a 
color interpolation step of performing color 
interpolation on the digital signal converted in said 
A/D conversion step and generating image data on a 
plurality of color planes; a separation step of 
separating the image data in the plurality of color 
planes into luminance data and color difference data; 
an extraction step of extracting a high frequency 



component from the luminance data separated in said 
Stjpciration step; and a pseudo color removing step of 
reducing a pseudo color generated in said color 
interpolation step, in accordance with the high 
frequency component of the luminance data extracted in 
said extraction step and hue data obtained from the 
color difference data. 

Herein, the pseudo color removing step comprises: 
a determination step of determining whether or not the 
high frequency component of the luminance data and the 
hue data fall within a color range of the pseudo color; 
and a step of reducing a value of the color difference 
data, determined to be within the color range in said 
determination step , 

Moreover, in the color space conversion step, it 
is preferable that the color space be converted to YUV, 
or Y, R-Y, B-Y, or G, R-G, B-G color space. 

Moreover, the image processing method may further 
comprise a step of removing a high frequency component 
from a color signal, from which the pseudo color is 
removed in said pseudo color removing step. 

Herein, the color range of the pseudo color 
includes a color area from red to yellow, and a color 
area from blue to cyan. 

Other features and advantages of the present 
invention will be apparent from the following 



description taken in conjunction with the accompanying 
arawings, in which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 

BRIEF DESCRIPTION OF THE DRAWINGS 
The accompanying drawings , which are incorporated 
in and constitute a part of the specification, 
illustrate embodiments of the invention, and together 
with the description, serve to explain the principles 
of the invention. 

Fig. 1 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the first embodiment of the present 
invention; 

Figs . 2A and 2B are conceptual views explaining 
pseudo color removal according to embodiments of the 
present invention ; 

Fig. 3 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the second embodiment of the 
present invention; 

Fig. 4 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the third embodiment of the present 
invention; 



Fig. 5 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the fourth embodiment of the 
present invention ; 

Fig. 6 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the fifth embodiment of the present 
invention; 

Fig. 7 is a block diagram showing a configuration 
of a pseudo color removing processor according to the 
fifth embodiment; 

Fig. 8 is a block diagram showing a configuration 
after the gamma converter shown in Fig. 6, for a 
digital camera according to the sixth embodiment of the 
present invention; 

Fig. 9 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the seventh embodiment of the 
present invention ; 

Fig. 10 is a conceptual view for explaining color 
interpolation according to embodiments of the present 
invention; 

Fig. 11 is an explanatory diagram showing a 
construction of a high frequency filter according to 
embodiments of the present invention; 

Fig. 12 is a graph explaining processing of a 



pseudo color suppression unit according to embodiments 
of the present invention; 

Fig, 13 shows a hue range of pseudo colors in 
pseudo color suppression processing according to 
embodiments of the present invention; 

Fig. 14 is a flowchart explaining pseudo color 
removing processing according to the seventh and eighth 
embodiments of the present invention; 

Fig. 15 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the eighth embodiment of the 
present invention ; 

Fig. 16 is a block diagram showing a construction 
of an image processing unit of a digital camera 
according to the ninth embodiment of the present 
invention; 

Fig. 17 shows a hue range of pseudo colors in 
pseudo color suppression processing according to the 
ninth embodiment of the present invention; 

Fig. 18 is a block diagram showing a construction 
of an image processing unit of a digital camera 
according to the tenth embodiment of the present 
invention; 

Fig. 19 is a conceptual view explaining a general 
pseudo color generation process; 

Fig. 20 is a conceptual view explaining a general 
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pseudo color generation process; 

Fig, 21 is a conceptual view explaining a general 
pseudo color generation process; and 

Fig. 22 is a conceptual view explaining a general 
pseudo color generation process. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Preferred embodiments of the present invention 

will be described in detail in accordance with the 

accompanying drawings . 

[ First Embodiment ] 

Fig. 1 is a block diagram showing, mainly, a 

construction of an image processing unit of a digital 

camera according to a first embodiment of the present 

invention. 

Light 1 , incident upon the digital camera 
according to the first embodiment, passes through lens 
2, then the amount of the light is adjusted by a 
diaphragm 3, and an image sensing device 5 (hereinafter 
referred to as a CCD), e.g., CCD or CMOS, is exposed 
while a shutter (not shown) is open. Before the light 
1 is incident upon the CCD 5, an optical low pass 
filter 20 limits a spatial frequency of the light 1 to 
reduce moir6 in a way that an optical area of a long 
wavelength is cut off by an infrared ray (IR) filter 4 
so that the CCD 5 does not detect light in the infrared 
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region . By the light incident upon the CCD 5 , the 
amount of electric charge corresponding to the 
intensity of light is accumulated in the CCD 5. The 
amount of electric charge is amplified by a 
predetermined gain by a CDS AGC 6 , and converted to 
digital data by an A/D converter 7 . Image data 
converted to digital data in the foregoing manner is 
transferred to a white balance circuit 8 where R, G and 
B gains are adjusted. Then, by a color interpolator 9, 
the image data is generated in, for instance, three 
color (R, G and B) planes. The image data expressed in 
the R, G and B planes are then transferred to a masking 
processor 10 where adjustment is made for the hue of 
the R, G and B colors. Then, a gamma converter 11 
performs necessary processing for displaying an image 
on a display or the like. 

Next, compression according to JPEG or the like 
is performed on the image data since the data in the R, 
G and B color planes has a large amount of data. 

Herein, first, an RGB/YUV converter 12 converts 
the image data from R, G and B signals to Y color 
difference signals. For instance, R, G and B data are 
respectively converted to Y, U and V as follows : 

Y= 0.29900 X R + 0.58700 X G + 0.11400 X B (1) 
U= -0.16874 X R - 0.33126 X G + 0.50000 X B (2) 



V= 0.50000 X R - 0.41869 X G - 0.08131 X B (3) 



Next, with respect to U and V, each representing 
a color difference signal, a pseudo color generated by 
color interpolation is reduced by median filters 13a 
and 13b. Low pass filters (LPF) 14a and 14b remove 
high frequency components to limit the band. Then, a 
thinning circuit 15 performs thinning processing which 
complies with a predetermined compression method, e.g., 
from Y:U:V = 4:4:4 to Y:U:V = 4:2:2 or Y:U:V = 4:1:1. 
Then, a compression circuit 16 adopting JPEG or the 
like performs compression. 

Figs. 2A and 2B explain the principle of 
processing performed by the median filters 13a and 13b 
according to the first (and subsequent) embodiment. 
Herein, Fig. 2A shows 3X3 pixels peripheral to a 
pixel of interest, and Fig. 2B shows a graph of pixel 
values arranged in the ascending order. 

Herein, for instance, 3X3 pixels peripheral to 
a pixel of interest a*22 are extracted, and the pixel 
values (color difference values) are arranged in the 
ascending order. Then, the value "20" of the pixel of 
interest is replaced with the value "10" of a*33, which 
is the substantial median value of the nine pixels. 
Such processing is performed by the median filters 13a 
and 13b, serving as isolated point removing filters. 



By this , isolated pseudo colors can be reduced without 
largely decreasing resolution. Note that since the 
configuration of the median filter is well known (e.g., 
disclosed in Japanese Patent Application Laid-Open No. 
5-233804 or No. 5-12437), detailed description thereof 
will be omitted. 

As has been described above, according to the 
first embodiment, a color space of an inputted image 
signal is converted from RGB to YUV color space, and an 
isolated pixel is removed from color difference signals 
U and V of the YUV signal by the median filter or the 
like. By virtue of this, pseudo colors generated by 
color interpolation can be reduced. 

[Second Embodiment] 

In the above-described first embodiment, color 
conversion from RGB to YUV color space is performed and 
pseudo color reduction processing is performed in the 
YUV color space before image compression is performed 
according to JPEG or the like. However, pseudo color 
reduction processing is not necessarily performed in 
YUV color space, but may be performed in another color 
space . 

According to the second embodiment of the present 
invention, pseudo color removal is performed by a 
median filter, after a color space of input image data 



is converted from RGB color space to R-Y, B-Y color 
space. 

Fig. 3 is a block diagram showing a construction 
of an image processing unit of a digital camera 
according to the second embodiment . For the components 
that are common to the construction shown in Fig. 1, 
the same reference numerals are assigned and 
description thereof will be omitted- The second 
embodiment largely differs from the foregoing first 
embodiment in that the second embodiment does not 
necessitate JPEG compression and that the YUV 
conversion can be eliminated since the pseudo-color- 
removed image data is stored in a memory 19. Therefore 
the construction of the image processing unit can be 
made simple, which contributes to the effect of the 
second embodiment . This is also applicable to a case 
of performing compression according to JPEG or the like 

According to the second embodiment, in order to 
achieve reduction in the amount of calculation compared 
to the case of converting data from RGB to YUV color 
space , image data is converted from RGB color space to 
Y, R-Y, B-Y color space by, for instance, using a Y, R- 
Y, B-Y converter 17a. 

Herein, for instance, color space conversion is 
executed in the following manner: 



Y = 0.29900 X R + 0.58700 X G + 0.11400 X B (4) 
= R-Y (5) 
B-Y = B-Y (6) 



Then, the median filters 17b and 17c respectively 
executes median filtering of the R-Y signal and B-Y 
signal. Herein, the equation can be further simplified 
as follows to obtain luminance signal Y, color 
difference signals R-Y and B-Y: 



Y = R+ 2XG + B = Ye 
R-Y = R-Ye 
B-Y = B-Ye 



(7) 
(8) 
(9) 



In this case, R-Ye and B-Ye are calculated with a 
luminance signal Ye which is a simplified (approximate) 
form of the luminance signal Y. By executing median 
filtering respectively to R-Ye and B-Ye, pseudo colors 
can be removed. Although the resultant values are 
slightly different from values of Y, R-Y and B-Y, a 
similar effect is achieved and calculation can be 
performed easily. Next, an RGB converter 17d 
respectively converts the Y, R-Y and B-Y signals back 
to R, G and B signals. The image data represented by R, 
G and B signals is subjected to masking by a masking 
processor 10 and to a gamma conversion by a gamma 
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converter 11, and then stored in the non-volatile 
memory 19. 

[Third Embodiment] 
5 In the above-described second embodiment, the 

luminance signal Y is consciously calculated from R, G 
and B signals. However, in image processing, G signal 
Cj of the R, G and B may substitute for the luminance 

signal Y. 

10 The third embodiment is characterized by 

fS employing G, R-G and B-G signals instead of Y, R-Y and 

B-Y signals employed in the second embodiment, and 

O 

executing median filtering to R-G and B-G signals 
IZ, respectively, 

I; Iff 

15 Fig. 4 is a block diagram showing a construction 

of an image processing unit of a digital camera 
according to the third embodiment of the present 
invention. For the components that are common to the 
construction shown in Fig. 3, the same reference 

20 numerals are assigned and description thereof will be 
omitted. 

According to the third embodiment, the amount of 
calculation is reduced further when compared against 
the case of converting R, G and B signals to luminance 
25 signal Y and color difference signals R-Y and B-Y, The 
G, R-G, B-G converter 18a generates G, R-G and B-G 
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signals from R, G and B signals using the following 
equations : 

Y = G (10) 
R-Y = R-G (11) 
B-Y = B-G (12) 

The median filters 18b and 18c respectively 
execute filtering to the R-G and B-G signals, thereby 
removing pseudo colors generated by color interpolation, 
Then, the RGB converter 18d converts the G, R-G and B-G 
signals back to RGB signals, which are then subjected 
to the masking processor 10 and gamma converter 11, and 
then stored in the non-volatile memory 19. 

As has been described above, since the third 
embodiment employs G signal in place of luminance 
signal Y, pseudo color reduction can be realized with a 
less amount of calculation, although there is a 
possibility that luminance components of the RGB 
signals may be influenced by the result of median 
filtering. 



[Fourth Embodiment] 

The above -described first to third embodiments 
describe the case of employing an optical low pass 
filter before the CCD 5. Note that the configuration 
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before the CCD 5 is not shown in Figs . 3 and 4 . 

The fourth embodiment describes a case where no 
problem arises even though the optical system does not 
comprise such optical low pass filter. 

Fig. 5 is a block diagram showing a construction 
of an image processing unit of a digital camera 
according to the fourth embodiment of the present 
invention. For the components that are common to the 
construction shown in Fig. 1, the same reference 
numerals are assigned and description thereof will be 
omitted. The fourth embodiment is characterized in 
that the IR filter 4 for cutting infrared rays is 
provided before the CCD 5, and that the optical low 
pass filter 20 employed in Fig. 1 is removed. The 
configuration after the CCD 5 is the same as that shown 
in block diagram of Fig. 1. 

However, when the optical low pass filter 20 is 
removed, pseudo colors are generated more than the case 
of including the optical low pass filter 20. In view 
of this, the number of elements in median filters 130a 
and 130b in the fourth embodiment is increased from the 
number of elements "9" of the median filters according 
to first to third embodiments. By this, the median 
filtering can be executed in a wider area, and pseudo 
colors can be reduced. 

Accordingly, since the fourth embodiment is 



realized by simply mounting the IR filter 4 on the 
glass surface of the CCD 5, the apparatus main body can 
be made small and cost reduction can be achieved. In 
addition, image signals of high resolution can be 
obtained. 



called smoothing (Edge Preserving Smoothing), which 
preserves edges, may be employed besides the above- 
described median filter. More specifically, a window 
W(i, J) is set with a pixel f(x, y) as its center, and 
an output g(x, y) is calculated. Assuming that the 
window size is m X n, the following equation stands: 



For instance, assuming a matrix M in which data "1" is 
arranged in 3 X 3 matrix, the following equation 
stands : 



For an alternative isolated point removing filter, 
another smoothing (Maximum Homogeneity Smoothing) which 
preserves edges may be employed. This smoothing 
enables selection of a most uniform area in the 



For the isolated point removing filter, filtering 



m 



n 




W = M/9 



neighborhood of a pixel, VHien the weight coefficient 
Fi is defined as follows: 

weight coefficient Fi = {min (ai)} / ai 
where an average value of each block is [il , 
distribution is ai, and m (arbitrary), 

the output g(x, y) is obtained in the following manner: 

8 8 

g{x,y)=y{Fr)fu}/yFr 

Besides the above, filtering called hysteresis 
smoothing may be employed. More specifically, a 
hysteresis characteristic is produced for a data value, 
and noise is absorbed by the hysteresis characteristic. 
Any of the aforementioned filters may be used as long 
as interpolation or smoothing is performed by using 
outputs of peripheral pixels of an isolated point 
having a pixel value largely different from peripheral 
pixel values . 

[Fifth Embodiment] 

Fig. 6 is a block diagram showing, mainly, a 

construction of an image processing unit of a digital 

camera according to the fifth embodiment of the present 



invention. For the components that are common to the 
foregoing embodiments , the same reference numerals are 
assigned. 

Light 1 , incident upon the digital camera 
according to the fifth embodiment, passes through the 
lens 2, then the amount of the light is adjusted by the 
diaphragm 3, and the image sensing device 5 
(hereinafter referred to as a CCD), e.g., CCD or CMOS, 
is exposed while a shutter (not shown) is open. Before 
the light 1 is incident upon the CCD 5 , a frequency 
region of a long wavelength is cut off by the IR filter 
4 so that the CCD 5 does not detect light in the 
infrared region. By the light incident upon the CCD 5, 
the amount of electric charge corresponding to the 
intensity of light is accumulated in the CCD 5 . The 
amount of electric charge is amplified by a 
predetermined gain by the CDS-AGC 6 , and converted to 
digital data by the A/D converter 7. Image data 
converted to digital data in the foregoing manner is 
transferred to the white balance circuit 8 where R, G 
and B gains are adjusted. Then, by the color 
interpolator 9, the image data is generated in, for 
instance, three color (R, G and B) planes. The image 
data expressed in the R, G and B planes are then 
transferred to the masking processor 10 where 
adjustment is made for the hue of the R, G and B colors. 



Then, the gamma converter 11 performs necessary 
processing for displaying an image on a display or the 
like. 

Next, a pseudo color removing processor 21 
reduces pseudo colors generated by color interpolation 
of the color interpolator 9. Further, compression 
processing according to JPEG or the like is performed 
on the image data since the data in the R, G and B 
color planes has a large amount of data. Herein, first, 
the RGB/YUV converter 12 converts the image data from R, 
G and B signals to Y color difference signal, and with 
respect to each of the color difference signals U and V, 
the LPF 14a and 14b respectively perform low pass 
filtering to limit the band. Then, the thinning 
circuit 15 performs thinning processing which complies 
with a predetermined compression method, e.g., from 
Y:U:V = 4:4:4 to Y:U:V = 4:2:2 or Y:U:V = 4:1:1. Then, 
a JPEG compression circuit 16 performs compression 
according to JPEG. 

Fig. 7 is a block diagram showing a configuration 
of the pseudo color removing processor 21 according to 
the fifth embodiment. 

Assume that image data is generated in R, G and B 
planes by the color interpolator 9 . The RGB/XYZ 
converter 21a converts image data from RGB color space 
to XYZ color space. The conversion is executed by the 



following equations (13) to (15): 



X= 2.7689 X R + 1.7517 X G + 1.1302 X B (13) 
Y= 1.0000 X R + 4.5907 X G + 0.0601 X B (14) 
Z= 0.0000 X R + 0.0565 X G + 5.5943 X B (15) 

Then, XYZ/L*a*b* converter 21b converts the image 
data from XYZ color space to L*a*b* color space. The 
conversion is executed by the following equations (16) 
to (18): 

L*= 116 (Y/YJ -16 (Y/Yo>0. 008856) (16) 
a*= 500 [(X/Xo)'^' - (Y-Yo)'''] (17) 
b*= 200 [(Y/Yo)''" - (Z-Zo)''"] (18) 

Xq, Yq and Zq represent tristimulus values of the 
perfect diffuse surface. 

Herein, median filters 21c and 21d, each serving 
as an isolated point filter, execute median filtering 
(median value filtering) respectively to a* and b* of 
the L*a*b*. 

Since the principle of the processing performed 
by the median filters 21c and 2 Id is the same as the 
aforementioned description shown in Figs. 2A and 2B, 
description thereof will not be provided herein. 

Then, L*a*b*/XYZ converter 21e converts image 



data from L*a*b* color space to XYZ color space. 
Finally, XYZ /RGB converter 2 If converts the image data 
from XYZ color space to RGB color space. By this, 
median filtering can be executed only in a color space 
that gives small influence to the luminance 
(resolution). Therefore, the decrease in resolution of 
an image can be prevented. 

[Sixth Embodiment] 

Fig. 8 is a block diagram showing a configuration 
according to the sixth embodiment of the present 
invention. 

In the foregoing fifth embodiment, image data in 
RGB color space, which has been outputted by the pseudo 
color removing processor 21, is converted from RGB 
color space to YUV color space by the RGB/YUV converter 
12 to be subjected to JPEG compression. This YUV 
conversion is executed by the aforementioned equations 
(1) to (3). 

According to the sixth embodiment, instead of the 
pseudo color removing processor 21, the median filters 
(median value filters) 17b and 17c execute filtering to 
U and V signals outputted by the RGB/YUV converter 12. 
Then, to perform JPEG compression, the LPF 14a and 14b 
perform low pass filtering to color difference data to 
limit the band of the color difference signals. Then, 



the thinning circuit 15 performs thinning into a 
predetermined format, e.g., from Y:U:V = 4:4:4 to Y:U:V 
= 4:2:2 or Y:U:V = 4:1:1, and compression is performed 
by the JPEG compression circuit 16. 

For the isolated point removing filter, filtering 
called smoothing (Edge Preserving Smoothing) for 
preserving edges, which has been described in the 
fourth embodiment, may be employed besides the above- 
described median filter. 

Furthermore, for the isolated point removing 
filter, smoothing (Maximum Homogeneity Smoothing) for 
preserving edges , which has been described in the 
fourth embodiment, may be employed. 

Besides the above, filtering called hysteresis 
smoothing may be employed. More specifically, a 
hysteresis characteristic is produced for a data value, 
and noise is absorbed by the hysteresis characteristic. 
Any of the aforementioned filters may be used as long 
as interpolation or smoothing is performed by using 
outputs of peripheral pixels of an isolated point 
having a pixel value largely different from peripheral 
pixel values . 

[Seventh Embodiment] 

A characteristic feature of the seventh 
embodiment is described before explaining a specific 
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example of the seventh embodiment . To eliminate the 
above -described pseudo colors, it is ideal to employ 
three -plate camera where CCDs are provided for each of 
the R, G and B color components. With such structure, 
the size of a camera increases. In the seventh 
embodiment, an attention is directed to the fact that 
pseudo colors generated from red (R) to yellow (Y) and 
from blue (B) to cyan (C) have high frequencies. Thus, 
the characteristic feature of the seventh embodiment is 
to suppress generation of pseudo colors by reducing the 
gain of a color difference signal when the luminance 
signal has a high frequency component and the hue falls 
within a predetermined range. 

Fig, 9 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the seventh embodiment of the 
present invention . 

Light 1, incident upon the camera, passes through 
the lens 2, then the amount of the light is adjusted by 
the diaphragm 3, and the image sensing device 5 
(hereinafter referred to as a CCD), e.g., CCD or CMOS, 
is exposed while a shutter (not shown) is open. Before 
the light 1 is incident upon the CCD 5 , a frequency 
area (band) of a long wavelength is cut off by the IR 
filter 4 so that the CCD 5 does not detect light in the 
infrared region. The light incident upon the CCD 5 is 



accumulated in the CCD 5 as an electric charge, and 
outputted as an electric signal. The electric signal 
is amplified by a predetermined gain by the CDS-AGC 6, 
and converted to digital data by the A/D converter 7. 
Image data converted to digital data in the foregoing 
manner is transferred to the white balance circuit 8 
where R, G and B gains are adjusted. Then, in the 
color interpolator 9, the image data is generated in, 
for instance, three color (R, G and B) planes as shown 
in Fig 10, The image data expressed in the R, G and B 
planes are then transferred to the masking processor 10 
where adjustment is made for the hue of the R, G and B 
colors. Then, the gamma converter 11 performs 
necessary processing for displaying an image on a 
display or the like. Further, compression processing 
according to JPEG or the like is performed on the image 
data since the data in the R, G and B color planes has 
a large amount of data. 

First, RGB/Y converter 22 converts RGB color 
space to color space of Y color difference signal- The 
conversion is executed by, for instance, above- 
mentioned equations (1) to (3). 

To detect high frequency components and hue, the 
image data, expressed in the R, G and B planes by the 
color interpolator 9, is subjected to calculation of a 
luminance signal Y by the RGB/Y converter 22, using the 



aforementioned equation (1). Next, to obtain a high 
frequency component of the obtained luminance signal Y, 
a spatial high pass filter (HPF) 23 executes spatial 
high pass filter computation as shown in Fig. 11. The 
luminance signal Y, obtained by the RGB/Y converter 22, 
is transferred to a hue detection circuit 24 for 
detecting a hue, where color difference signals R-Y and 
B-Y are calculated and a hue is detected based on the 
calculated results. The detected hue data is outputted 
to a pseudo color suppression circuit 13. Referring to 
Fig. 11, spatial high pass filter computation is 
executed by multiplying an input signal by a matrix 300, 
and subtracting the input signal from the 
multiplication result by a subtracter 301. 

The pseudo color suppression circuit 13 
suppresses pseudo colors by reducing gains of U and V, 
outputted by the RGB/Y converter 22, based on the high 
frequency component of the luminance signal Y obtained 
by the spatial high pass filter 23 and the hue data 
obtained by the hue detection circuit 24. 

The pseudo color suppression processing is 
described with reference to Figs. 12 and 13. 

First, it is determined whether or not a color of 
the pixel of interest falls within a predetermined 
range (area indicated by hatching in Fig. 13) in Y, R-Y, 
B-Y color space. If the color is determined to be in 



the range where it is considered as a pseudo color, 
gains of the color difference signals U and V, having a 
predetermine value ofl or larger as shown in Fig. 12, 
are reduced in accordance with a high frequency 
5 component value of the luminance signal outputted by 
the spatial high pass filter 23. By this, pseudo 
colors can be suppressed. 

Pseudo color suppression processing performed in 
the above- described configuration is explained. A high 
10 frequency component , such as that having a vertical 

stripe pattern or a checker flag pattern described with 
reference to Figs. 19 to 22, is extracted by the 

tJ 

M spatial HPF 23. The aforementioned pseudo color 

CO generation is prevented by reducing gains of color 

M 

p 15 difference signals U and V in the extracted high 

frequency area, which may cause pseudo colors described 
in Figs. 19 to 22 (for instance, predetermined areas of 
R and Y components in Fig. 19, predetermined areas of C 
and B components in Fig. 20, or predetermined areas of 

20 R and B components in Figs. 21 and 22, all of which 
correspond to the hatching portion in Fig. 13). 

Next, the low pass filter (LPF) 14 execute low 
pass filtering in the horizontal or vertical direction. 
Then, the thinning circuit 15 performs thinning 

25 processing of the color difference signals, in 

accordance with a predetermined JPEG format, e.g., from 
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Y:U:V = 4:4:4 to Y:U:V = 4:2:2 or Y:U:V = 4:1:1. Then, 
the JPEG compression circuit 16 performs JPEG 
compression. By this, a compressed image having less 
pseudo colors can be generated. 

Note herein that instead of calculating the 
luminance signal Y by the aforementioned equation (1), 
the calculation may be executed with a simplified 
luminance signal Ye. For instance, aforementioned 
equation (7), Ye = R + 2XG + B, may be used. 

Alternatively, a green (G) signal component may 
be used as a luminance signal without calculating the 
luminance signal. 

Fig. 14 is a flowchart explaining pseudo color 
removing processing according to the seventh embodiment 
of the present invention. 

Referring to Fig. 14, in step SI, R, G and B 
signals of an image, upon which color interpolation 
processing has been performed, are inputted and a 
luminance signal Y is generated from the R, G and B 
signals by the RGB/Y converter 22. In step S2, high 
frequency components of the luminance signal Y are 
extracted by the spatial high pass filter (HPF) 23. In 
step S3, differences are respectively calculated 
between each of R, B signals and the luminance signal Y 
by the hue detection circuit 24, and color difference 
signals R-Y and B-Y are generated. In step S4, a hue 



signal is generated based on the color difference 
signals, and it is determined whether or not the hue 
signal falls within a color range that is considered as 
pseudo colors. If it is determined as a pseudo color 
in step S5, the control proceeds to step S6 where gains 
of the color difference signals in the pseudo color 
portion are reduced in accordance with the amount of 
high frequency component of the pixel. By this, for 
instance, in the color space corresponding to the 
hatching area in Fig. 13, pseudo color components 
generated by color interpolation can be suppressed. 
Then the process proceeds to step S7, isolated pixels 
of the image are removed. 

As described above, the seventh embodiment 
achieves an effect of preventing pseudo colors 
generation from red to yellow and from blue to cyan. 

[Eighth Embodiment] 

A characteristic feature of the eighth embodiment 
is described before explaining a specific example of 
the eighth embodiment. To eliminate the above- 
described pseudo colors, it is ideal to employ three- 
plate camera where CCDs are provided for each of the R, 
G and B color components. With such structure, the 
size of a camera increases. In the eighth embodiment, 
an attention is directed to the fact that pseudo colors 



generated from red (R) to yellow (Y) and from blue (B) 
to cyan (C) have high frequencies. Thus, the 
characteristic feature of the eighth embodiment is to 
suppress generation of pseudo colors by removing an 
isolated point of a luminance signal, having a high 
frequency component and, if the hue falls within a 
predetermined range, reducing the gain of the color 
difference signal . 

Fig. 15 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the eighth embodiment of the 
present invention . 

The pseudo color suppression circuit 13 
suppresses pseudo colors by reducing gains of U and V, 
outputted by the RGB/YUV converter 22, based on a high 
frequency component of the luminance signal Y obtained 
by the spatial high pass filter 23 and hue data 
obtained by the hue detection circuit 24. The pseudo 
color suppression processing is performed in the same 
manner as that of the above -described seventh 
embodiment . 

Among the above-described pseudo colors, patterns 
of pseudo colors from red (R) to yellow (Y) and from 
blue (B) to cyan (C) can be determined as pseudo colors 
by detecting high frequency components of the luminance 
signal because the degree of luminance of pseudo colors 



are different from others. However, pseudo colors 
generated around a character are often isolated, and 
the degree of luminance of ht pseudo colors are not 
always different from the peripheral pixel luminance. 

In view of the above, according to the eighth 
embodiment, the median filters 24a and 24b remove 
isolated points with respect to the color difference 
signals U and V and further perform pseudo color 
removal. Figs. 2A and 2B explain this processing. 
Herein, elements having 3X3 pixel area including a 
pixel of interest are arranged in the ascending order, 
and the value of the pixel of interest is replaced with 
a median value of the arranged pixels . By this , a 
pixel, having a color of extremely different hue from 
the hues of peripheral pixels, can be eliminated. 
Particularly, since the low pass filtering is not 
executed in the eighth embodiment, resolution does not 
decrease largely, thus does not influence peripheral 
pixels , 

Pseudo color suppression processing performed in 
the above-described configuration is explained. A high 
frequency component, such as that having a vertical 
stripe pattern or a checker flag pattern described with 
reference to Figs. 19 to 22, is extracted by the 
spatial HPF 23. The aforementioned pseudo color 
generation is prevented by reducing gains of color 



difference signals U and V in the extracted high 
frequency area, which may cause the pseudo colors 
described in Figs. 19 to 22 (for instance, 
predetermined areas of R and Y components in Fig. 19, 
predeteormined areas of C and B components in Fig. 20, 
or predetermined areas of R and B components in Figs. 
21 and 22, all of which correspond to the hatching 
portion in Fig. 13). After pseudo colors are 
suppressed in the foregoing manner, the median filters 
24a and 24b execute above-described filtering, thereby 
removing isolated pixels . 

Next, the low pass filter (LPF) 14a and 14b 
execute low pass filtering in the horizontal or 
vertical direction. Then, the thinning circuit 15 
performs thinning processing of the color difference 
signals, in accordance with a predetermined JPEG format, 
e.g., from Y:U:V = 4:4:4 to Y:U:V = 4:2:2 or Y:U:V = 
4:1:1, Then, the JPEG compression circuit 16 performs 
JPEG compression. By this, a compressed image having 
less pseudo colors can be generated. 

Note that, to calculate the luminance signal Y, 
the aforementioned equation (7) may be used. 

Alternatively, a green (G) signal component may 
be used as a luminance signal without calculating the 
luminance signal. 

Since the pseudo color removal processing 



according to the eighth embodiment is performed in the 
same manner as that explained in the flowchart in Fig, 
14, detailed description will be omitted herein, 

[Ninth Embodiment] 

In the foregoing seventh and eighth embodiments, 
means for detecting pseudo colors is provided after the 
color interpolator 9 and pseudo color detection is 
performed using signals in the R, G and B planes. The 
reason is that, since processing such as masking 
processing, 7 conversion and so forth that may cause 
changes in hue are performed after the color 
interpolator 9, the hue range of the detected pseudo 
colors may change. Because of this reason, the 
luminance signal Y is calculated to obtain color 
difference signals R-Y and B-Y. However, the pseudo 
color detection means does not have to be provided in 
this position. For instance, in order to perform JPEG 
compression, RGB color space must be converted to a 
color space of luminance or color difference . 
Therefore, pseudo colors can be detected from these 
signals. The ninth embodiment relates to such case. 
Note that, as mentioned above, there is a possibility 
that the hue range of pseudo colors changes depending 
on images . 

Fig, 16 is a block diagram showing a construction 
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of an image processing unit of a digital camera 
according to the ninth embodiment of the present 
invention. For the components that are common to the 
construction shown in Fig. 9, the same reference 
numerals are assigned . 

Light 1, incident upon the camera, passes through 
the lens 2, then the amount of the light is adjusted by 
the diaphragm 3 , and the CCD 5 is exposed while a 
shutter (not shown) is open. Before the light 1 is 
incident upon the CCD 5 , a frequency area of a long 
wavelength is cut off by the IR filter 4 so that the 
CCD 5 does not detect light in the infrared region. 
The light incident upon the CCD 5 is accumulated in the 
CCD 5 as an electric charge, and outputted as an 
electric signal. The electric signal is amplified by a 
predetermined gain by the CDS-AGC 6, and converted to 
digital data by the A/D converter 7 - Image data 
converted to digital data in the foregoing manner is 
transferred to the white balance circuit 8 where R, G 
and B gains are adjusted. Then, in the color 
interpolator 9, the image data is generated in, for 
instance, three color (R, G and B) planes as shown in 
Fig. 2. The image data expressed in the R, G and B 
planes are then transferred to the masking processor 10 
where adjustment is made for the hue of the R, G and B 
colors. Then, the gamma converter 11 performs 



necessary processing for displaying an image on a 
display or the like. Then, RGB/YUV converter 12 
converts the image data from RGB color space to color 
space of Y color difference signal . 

Among the converted signals , luminance signal Y 
is transmitted to the spatial high pass filter (HPF) 25 
for detecting high frequency components of the signal 
by the filtering shown in Fig. 11. Then, a hue 
detection circuit 26 determines whether or not a pixel 
of interest falls within the hue range of pseudo colors. 
Herein, instead of the above-described color space R-Y 
and B-Y shown in Fig. 13, U and V outputted by the 
RGB/YUV converter 12 are used as shown in Fig. 17. 

As similar to the seventh and eighth embodiments, 
if it is determined that a color of the pixel of 
interest falls within the hue range of pseudo colors, 
the pseudo color suppression circuit 13 reduces gains 
of the color difference signals U and V, having a value 
ofl or larger as shown in Fig. 12, in accordance with 
an output value of the spatial HPF 25. 

In this case, for instance, it may be necessary 
to change, for instance, the hue range depending on the 
white balance. For instance, when the gain of red is 
increased, the hue range is shifted towards red, or a 
hue angle is widened. 

Next, the LPF 14a and 14b execute low pass 



filtering in the horizontal or vertical direction. 
Then, the thinning circuit 15 performs thinning 
processing of the color difference signals, in 
accordance with a predetermined JPEG format, e.g., from 
Y:U:V = 4:4:4 to Y:U:V = 4:2:2 or Y:U:V = 4:1:1, Then, 
the JPEG compression circuit 16 performs JPEG 
compression. 

By this, a compressed image having less pseudo 
colors can be generated . 

[Tenth Embodiment] 

In the foregoing seventh and eighth embodiments , 
means for detecting pseudo colors is provided after the 
color interpolator 9 and pseudo color detection is 
performed using signals in the R, G and B planes. The 
reason is that, since processing such as masking 
processing, y conversion and so forth that may cause 
changes in hue are performed after the color 
interpolator 9, the hue range of the detected pseudo 
colors may change. Because of this reason, the 
luminance signal Y is calculated to obtain color 
difference signals R-Y and B-Y. However, the pseudo 
color detection means does not have to be provided in 
this position. For instance, in order to perform JPEG 
compression, RGB color space must be converted to a 
color space of luminance and color difference. 



Therefore, pseudo colors can be detected from these 
signals. With reference to the foregoing eighth 
embodiment (Fig. 15), in the median filters 24a and 24b 
where pseudo color suppression is performed, delay is 
generated between the luminance signal Y and color 
difference signals U and V. Because of this, the 
luminance signal must also be delayed. The tenth 
embodiment makes use of this delay. 

Fig. 18 is a block diagram showing a construction 
of an image processing unit of a digital camera 
according to the tenth embodiment of the present 
invention. For the components that are common to the 
construction shown in Fig. 15, the same reference 
numerals are assigned. 

Light 1, incident upon the camera, passes through 
the lens 2, then the amount of the light is adjusted by 
the diaphragm 3, and the CCD 5 is exposed while a 
shutter (not shown) is open. Before the light 1 is 
incident upon the CCD 5, a frequency area of a long 
wavelength is cut off by the IR filter 4 so that the 
CCD 5 does not detect light in the infrared region. 
The light incident upon the CCD 5 is accumulated in the 
CCD 5 as an electric charge, and outputted as an 
electric signal. The electric signal is amplified by a 
predetermined gain by the CDS-AGC 6 , and converted to 
digital data by the A/D converter 7. Image data 



converted to digital data in the foregoing manner is 
transferred to the white balance circuit 8 where R, G 
and B gains are adjusted. Then, in the color 
interpolator 9, the image data is generated in, for 
instance, three color (R, G and B) planes as shown in 
Fig. 2, The image data expressed in the R, G and B 
planes are then transferred to the masking processor 10 
where adjustment is made for the hue of the R, G and B 
colors. Then, the gamma converter 11 performs 
necessary processing for displaying an image on a 
display or the like. Then, RGB/YUV converter 12 
converts the image data from RGB color space to color 
space of Y color difference signal. 

Among the converted signals, luminance signal Y 
is transmitted to the spatial high pass filter (HPF) 25 
for detecting high frequency components of the 
luminance signal by the filtering shown in Fig. 11. 
Meanwhile, color difference signals U and V are 
transmitted to the median filters 24a and 24b for 
executing the above-described median filtering shown in 
Figs. 2 A and 2B. By virtue of this, while high 
frequency components of the luminance signal Y are 
detected, median filtering is executed to the color 
difference signals. Therefore, it is possible to 
reduce wasteful use of a memory caused by delay of one 
of the signals . 



Next, the hue detection circuit 26 determines 
whether or not a pixel of interest falls within the hue 
range of pseudo colors. Herein, instead of the above- 
described color space R-Y and B-Y shown in Fig. 13, U 
5 and V outputted by the RGB/YUV converter 12 are used as 
shown in Fig. 17. 

As similar to the eighth embodiment, if it is 
determined that a color of the pixel of interest falls 
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difference signals U and V, having a value ofl or 
larger as shown in Fig. 12, in accordance with an 
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In this case, for instance, it may be necessary 
15 to change, for instance, the hue range depending on the 
white balance. For instance, when the gain of red is 
increased, the hue range is shifted to the red, or a 
hue angle is widened. 

Next, the LPF 14a and 14b execute low pass 
20 filtering in the horizontal or vertical direction. 
Then, the thinning circuit 15 performs thinning 
processing of the color difference signals, in 
accordance with a predetermined JPEG format, e.g., from 
Y:U:V = 4:4:4 to Y:U:V = 4:2:2 or Y:U:V = 4:1:1. Then, 
25 the JPEG compression circuit 16 performs JPEG 
compression. 
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By this, a compressed image having less pseudo 
colors can be generated. 

The present invention can be applied to a system 
constituted by a plurality of devices (e.g., host 
computer, interface, reader, printer) or to an 
apparatus comprising a single device (e.g., copying 
machine, facsimile machine). 

Further, the object of the present invention can 
also be achieved by providing a storage medium storing 
program codes for performing the aforesaid processes to 
a computer system or apparatus (e.g., a personal 
computer), reading the program codes, by a computer 
(CPU or MPU) of the system or apparatus, from the 
storage medium, then executing the program. 

In this case, the program codes read from the 
storage medium realize the functions according to the 
embodiments, and the storage medium storing the program 
codes constitutes the invention. 

Further, the storage medium, such as a floppy 
disk, a hard disk, an optical disk, a magneto-optical 
disk, CD-ROM, CD-R, a magnetic tape, a non-volatile 
type memory card, and ROM can be used for providing the 
program codes . 

Furthermore, besides aforesaid functions 
according to the above embodiments are realized by 
executing the program codes which are read by a 



computer, the present invention includes a case where 
an OS (operating system) or the like working on the 
computer performs a part or the entire processes in 
accordance with designations of the program codes and 
realizes functions according to the above embodiments. 

Furthermore, the present Invention also includes 
a case where, after the program codes read from the 
storage medium are written in a function expansion card 
which is Inserted into the computer or in a memory 
provided in a function expansion unit which is 
connected to the computer, CPU or the like contained in 
the function expansion card or unit performs a part or 
the entire process in accordance with designations of 
the program codes and realizes functions of the above 
embodiments . 

As has been set forth above, according to the 
above -described embodiments, RGB color space is 
converted to YUV or Y, R-Y, B-Y or G, R-G, B-G color 
space, and Isolated point removing filtering (e.g., 
median filter or the like) is executed respectively to 
color difference signals in UV, or R-Y, B-Y or R-G, B-G 
color space, thereby enabling reduction of pseudo 
colors generated by color interpolation. 

Furthermore, according to the above -describe 
embodiments, even if an optical low pass filter is not 
provided before the image sensing device, such as CCD 



or the like, pseudo color components can be reduced by 
converting RGB color space to L*a*b* or YUV color space, 
then performing filtering to color difference signals 
such as a* and b* signals or U and V signals with the 
isolated point removing filter, and then performing 
compression according to JPEG or the like. Accordingly, 
an image, having less block distortion and reduced 
pseudo color components, can be obtained. 

Furthermore, according to the above-described 
embodiments, pseudo colors generated by color 
interpolation can be suppressed by detecting high 
frequency components of a luminance signal and pseudo 
colors generated from red to yellow and from blue to 
cyan in the hue , and then reducing gains of color 
difference signals U and V. 

Still further, according to the above -described 
embodiments, pseudo colors generated by color 
interpolation can be suppressed by detecting high 
frequency components of a luminance signal and pseudo 
colors generated from red to yellow and from blue to 
cyan in the hue, then reducing gains of color 
difference signals U and V, and further eliminating 
isolated pixels. 

Still further, according to the above-described 
embodiments, pseudo colors generated by color 
interpolation can be suppressed by executing median 



filtering to color difference signals in the color 
space of luminance and color difference signals, then 
detecting high frequency components of a luminance 
signal and pseudo colors generated from red to yellow 
and from blue to cyan in color difference signals, and 
reducing gains of color difference signals U and V. 

Still further, according to the above-described 
embodiments, by executing median filtering to color 
difference signals while detecting high frequency 
components of a luminance signal, it is possible to 
eliminate a processing circuit necessary to match 
delayed timing of the luminance signal and color 
difference signals . 

The present invention is not limited to the above 
embodiments and various changes and modifications can 
be made within the spirit and scope of the present 
invention. Therefore, to apprise the public of the 
scope of the present invention, the following claims 
are made . 
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